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Riemannian optimal control 

Andreea Bejenaru and Constantin Udri§te 



Abstract 



The aim of this paper is to adapt the general niultitime maxi- 
/"N ' mum principle to a Riemannian setting. More precisely, we intend to 

study geometric optimal control problems constrained by the metric 
compatibility evolution PDE system; the evolution ("multitime") vari- 
ables are the local coordinates on a Riemannian inanifold, the state 
variable is a Riemannian structure and the control is a linear connec- 
tion compatible to the Riemannian metric. We apply the obtained 
results in order to solve two flow-type optimal control problems on 
Riemannian setting: firstly, we maximize the total divergence of a 
fixed vector field; secondly, we optimize the total Laplacian (the gra- 
dient flux) of a fixed differentiable function. Each time, the result is 
a bang-bang-type optimal linear connection. Moreover, we emphasize 
CS . the possibility of choosing at least two soliton-type optimal (semi-) 

yp^ I Riemannian structures. Finally, these theoretical examples help us to 

lO ' conclude about the geometric optimal shape of pipes, induced by the 

^O , direction of the flow passing through them. 

• i Keyv^ords: multitime maximum principle, Riemannian optimal 

^-J ' control, shape optimization, gradient flow, total divergence, total Lapla- 

^ ■ cian, bang-bang-type optimal solution, soliton-type metric. 

MSC2010: 49J20, 49N05, 49Q10, 53C05, 53C80. 



^ : 1 Adjoint PDE systems 

in Riemannian geometry 



A connection on a manifold is a type of differentiation that acts on vector 
fields, differential forms and tensor products of these objects (see [2], [6], 
[TT]). Its importance lies in the fact that given a piecewise continuous curve 
connecting two points on the manifold, the connection defines a linear iso- 
morphism between the respective tangent spaces at these points. Another 
fundamental concept in the study of differential geometry is that of a Rieman- 
nian metric. It is well known that a Riemannian metric uniquely determines 



a Levi-Civita connection: a symmetric connection for which the Rieman- 
nian metric is parallel. Since we may define linear connections unattached 
to Riemannian metrics, it is natural to ask, for a symmetric connection, if 
there exists a parallel Riemannian metric, that is, whether the connection is 
a Levi-Civita one. More generally, a connection on a manifold M, symmetric 
or not, is said to be metric if admits a parallel Riemannian metric defined on 
M. Then, the equations describing the metric property of symmetric linear 
connections are called metric compatibility evolution PDE system. 

Let M be an n-dimensional differentiable manifold with local coordinates 
(x^, ..., x"). As we have mentioned above, fixing a Riemannian structure g on 
M ensures us about the existence of a symmetric linear connection satisfying 
the metric compatibility PDE system V _a_g = 0, Vz = 1, ...,n. 

Let us change the geometric point of view in those of deformation theory. 
In this sense, let us discuss about the Riemannian metric controlled by a 
connection. For that we consider the controlled evolution law (linear PDE 
system) 



{PDE) 



da ■ r 1 

-Q^i^) = 9ps{x) [5fr^'fc(x) + (5jrffc(2;)J , i,j,k = l,...,n. 



together with the initial condition 



(xo) 



9ij{Xo) — Viji 



where the piecewise metric tensor g = (gij) denotes a symmetric state tensor, 
X = {x^, ...,x") is the multitime variable (see [1], [3], [12] -[21]), and V = (Ff^) 
denotes the symmetric control linear connection. 

The PDE system has solutions if and only if the complete integrability 
conditions 
(CIC) 

^ {9,s [5f q. + m,] } = ^ {g,. [SfT^, + 5jFfJ } , v., J, k,l = l, ..., 



,n 



are satisfied. Explicitly, this means Rijki + Rjiki = 0, where Rijki denotes the 
Riemann curvature tensor field corresponding to the solution {g,T). 
We consider the set of admissible controls 



W = {F : M ^ i?" I F 



V 



F^j. 



Since the PDE system is linear, it coincides with its infinitesimal de- 
formation, around a solution gij{x). This PDE is also auto-adjoint since 
vpfi — pvt2 = 0, for any two solutions v{x,t) and p{x,t). If it is used as 
adjoint equation, then a solution p{x, t) is called the costate function. 



{ADJ) 



The foregoing PDE systems determine the multitime adjoint PDEs 



dx^ 



\x 



-\^^\x)[5lTi,{x) + 51T' 



pk 



»], 



whose solution A = (A*-''^), called the costate tensor, is not necessary sym- 
metric. The systems (PDE) and (ADJ) are adjoint (dual) in the sense of 
zero divergence of the vector field Q{x) = {Q^{x) = yij{x)X^^^{x)), where 
y{x) = {yij{x)) denotes an infinitesimal deformation around a solution gij{x). 
The symmetry of the state and control variables suggests us to consider 
a symmetrized adjoint PDE system, corresponding to the symmetric costate 
variables p^^^ = X^^ + X^^^. By computation, p is solution for 



{ADr 



dp 



ijk 



dx^ 



[X) 



-f'\xWrs,{x)+5iT\,{x)]. 



Again, {PDE) and {ADJ'^) are dual in the sense of zero divergence of the 
vector field S{x) = {S''{x) = yij{x)p''^^{x)). 

Moreover, introducing the Hamiltonian H{x, g, T,p) = p^-'^Qis^^, the evo- 
lution systems {PDE) and {ADJ'^) become 



{x,g{x),T{x),p{x)), 



{PDE) 


^^'= (x) - 


dH 

dpijk 


dH 


{x,^ 


respectively 




{ADJ') 






'dH 

pg^j 


dH' 

dgji_ 



{x,g{x),T{x),p{x)). 



2 Geometric optimal control with 
metric evolution-type constraints 

2.1 Multitime maximum principle 

In this section we consider a general control problem, with functional defined 
as multiple integral and evolution described by the Riemannian metric com- 
patibility PDE system. Its solution is based on a general multitime maximum 
principle analyzed, under different aspects in [3] and [I2]-[2T], and general- 
izing the classical approach on single-time Pontriaguine maximum principle 
(see [l],[7]-[Tn], |22])- More precisely, in [21] we have proved, using needle- 
shaped control variations, that, given the hyper-parallelepiped fioto in R"^ 



having and tg as diagonal points, the solutions for the multitime optimal 
control problem with running cost and integral cost on boundary, 

max( J[m(-)] = / X{t,x{t),u{t))dt+ f x{t,x{t)) da] 

«(■) V Jnoty JdUotQ J 

subject to —-^{t) = Xl^{t,x{t),u{t)), i = 1, ...,n, a = 1, ...,m, 

u{t) e i?^ x{t) G i?", te l^oto C R""^ a;(0) = xo, 

with the corresponding control Hamiltonian 

H{t,x,p,u) = X(t,x,u) +p°X^(t,a;,-u), 

satisfy the multitime maximum principle described in the next fundamental 
outcome. 

Theorem (Multitime maximum principle). Suppose u*{-) is an op- 
timal solution of the control problem and x*{-) is the corresponding optimal 
state. Then there exists a costate tensor p* = (p*") : l^oto ~> -R™"" such that 

H{t,x*{t),p*{t),u*{t)) = max H{t,x*{t),p*{t),u{t)), Vt G fioto 

«(■) 

and 

naPi IdQoto — Q^ilanoto- 



2.2 Riemannian optimal control 

If {M,g) is a Riemannian manifold, let x = (a;^,...,x") denote the local 
coordinates relative to a fixed local map {V,h). Since h : V ^ i?" is an 
isomorphism, we denote by f^^Qa,^ a subset of V diffeomorphic through h with 
the hyper-parallelepiped in i?" having /i(zo) and h{xi) as diagonal points. 
li X = X{x,g,r) and x = xi^-,9) ^-^e differentiable maps, we associate the 
Bolza-type cost functional 

J[r] = / X{x,g{x),T{x))dx + / x(a;, (/(x))(icr. 



where dx denotes the differential n-form lix^ A... Adx" (the Euchdean volume 
element on fixoiii) ^^^ da is the Euclidean volume element on the boundary. 
The multitime optimal control problem consists in finding 



(J) max J[r] = / X{x,g{x),T{x)) dx + / xi^^9{^)) da 



subject to the evolution system 
{PDE) 



dO' ■ r 1 

-Q^i^) = 9ps{x) [5fr^fe(x) + (5jr.;.(x)J , i,j,k=l,...,n 



and the initial condition 

(xo) 



gixo) = rj. 



Since the main ingredients of this Riemannian optimal control problem 
(the state variables, the control variables and evolution constraints (PDE)) 
are symmetric, we shall derive an adapted multitime maximum principle, 
based on symmetric costate variables. For this, we introduce the symmetric 
Lagrange multipliers p"^^^ = jP"^^ and the reduced control Hamiltonian 



(H) 



H{x,g,r,p) = X{x,g,r)+g,,r%p'^\ 



Corollary 1 (Riemannian maximum principle). Suppose the sym- 
metric connection T*{-) is an optimal solution for {{PDE),{J),{xo)) and 
that g*{-) is the corresponding optimal Riemannian structure. Then there 
exists a symmetric dual tensor p* = (p**^*^) : fi^^^-^ -^ i?" such that 



{PDE) 



dx'^ 



(X 



dH dH 

+ 



Qipijk Qr)^^ 



(x,5f*(x),r*(x),p*(x)). 



{AD.r 

and 



dp 



*ijk 



dx'' 



[X 



dH dH 

dgij dgji 



(x,/(x),r*(x),p*(x)) 



{Opt) H{x,g*{x),r*{x),p*{x)) =maxH{x,g*{x),r{x),p*{x)), \/x e Q^oxi- 



Finally, the boundary conditions 
{dVt,,^,) nkp*'%n.^,^. 



dx dx 



dgij dgj 



3''' f)0 



are satisfied, where n denotes the covector corresponding to the unit normal 
vector on ^fi^^g^;^ . 

Proof. We denote by H the standard control Hamiltonian corresponding 
to the Riemannian optimal control problem ((J), (PDE), (xq)), that is 

H{x, g, T, A) = X{x, g, T) + X^'^ [^^.(x, g, V) + g.s^U^, g, T 

= x{x, g, r) + g,sr% [y^' + x^^'] = h{x, g, r, y^' + x^^'). 

Let us define the symmetric costate tensor p"^^^ = X^^^ + X^"^^ . Writing 
the multitime maximum principle with standard Hamiltonian, and using the 
definition of p, we obtain 



dg*, OH 



dH dH 

+ 



dx^ dX'J'' dp'-i^ (9pJ*^ 



Qp*ijk Q\*ijk Q\*Ji 



ik 



dx^ 



dx^ 



dx^ 



dH dH 



dgij dg 



31-] 



dH dH 

+ 



H{x,g\V\p*) = H{x,g\T\X*) = maxH{x, g*,T, X*) = max H {x, g\T,p*); 



nkP*'%n, 



rik 



\*ijk _i_ \*jik 



dgij dgj^^ 
IX H{ 

dx , dx 



dgij dg 



ji- 



C** ixQX-^^ 



n 



Remark. By replacing the metric compatibility evolution (PDE) with 
the PDE system corresponding to the dual tensor g~^: 



[PDE') 



dg 



«j 



{x) = -g^\x) \5lTi,{x) + 5lT\,{x)\ , t,j,k = l,...,n, 



dx'' 
with initial condition 

(x'o) g'^ixo) = v'' 

and using the dual Hamiltonian 



H'{x,g-\T,p) = X{x,g,T) - g^^Ti,pf^, 

we can rephrase the Riemannian multitime maximum principle as it follows. 
Corollary 2 (Riemannian dual maximum principle). Suppose the 
symmetric connection T* {■) is an optimal solution for {{PDE') ^ (J), (xq)) and 
that g*'^{-) is the corresponding optimal state. Then there exists a symmetric 
dual tensor p* = {p*j) : ^x^xi — ^ -R" such that 



'PDE') 



dx'' 



[X 



dH' dH' 

dPij dp'^ji^ 

6 



x,g* {x)J*{x),p*{x)), 



{ADf- 



dp* 



*k 
ij 



dx'' 



X) = — 



dH' dH' 

- + 



dg^^ dg- 



a« 



x,g* {x),T*{x),p*{x)) 



and 
(Opt) 
H'{x,g* ^{x),T*{x),p*{x)) = max H\x,g* ^{x),T{x),p*{x)), Vx G r2^„^^. 



Finally, the boundary conditions 



are satisfied. 



"^kPij \dQ.XQX-^ 



9^, 9x 



dgio dgi"- 



3 Flux-type optimal control problems 

Throughout this section, the basic geometric ingredients have the same sig- 
nificance as above; that is, (M, g) is a Riemannian manifold with local co- 
ordinates X = (a;^, ...,x"') and fixoxi denotes a subset of M diffeomorphic 
with a hyper-parallelepiped in K^. The main goal of the section consists in 
analyzing two flux-type Riemannian optimal control problems, resulting in 
bang-bang-type optimal solutions. The key ideea is to take x = {x^,...,x"') 
like an evolution (deformation) parameter. 



3.1 Optimization of total divergence 

In this subsection, X is a fixed vector field on Qxqxi- The optimal control 
problem we are looking to solve consists in finding the control connection 

(rj) eu = {T: nx,x. ^ [-1, i]"'| rf,. = ry 

that maximize the total divergence of X. More precisely, we try to find 
the optimal linear connection and the optimal Riemannian structure that 
maximize the Bolza-type functional 



(J) 



J[T]= f BivXdv= f DivX^dx, 

"^ ^ ^Xl\Xl ^ ' ^Xi\XA 



where g = det{gij), subject to the dual metric compatibility evolution PDE 
system 



[PDE') 



dg 



V 



dx^ 



(x) = -g^^x) te(x) + <5^r;,(a;)] , i,3,k = l,...,n. 



with initial condition 

Remark. By applying the Divergence Theorem in Riemannian setting, 
we may rewrite the functional J[r] as 



J[T]= / giX,N^)d^a, 

or, using local coordinates. 

In the expressions above, if A^^ = (A^*) is the outpointing normal vector 
field on the boundary, with respect to the metric g^ then n = {rii = gijN^), 
denotes the Euclidean normal covector along the boundary. This allows us to 
identify the running cost, respectively the boundary cost associated to this 
optimal control problem: 

X{x, g-\ T) = 0; x{x. g-') = X'^n,, 

giving the corresponding control Hamiltonian 

H\x,g~\V,p) = -g^^Vi,p^^. 

Since this Hamiltonian is linear with respect to the control components F^-, 
we have no interior optimal control F^-; for optimum, the control must be at 
a vertex of [—1, 1]" (see linear optimization, simplex method). 
Writing the adjoint PDE system 



^P% _ J^ 



dx^ 



Pi 






we obtain the immediate solution p*j^ = C'glj, with C = (C^) : ^xaxi -^ R" 
^ = 0. Then 

ox" 

ks' 



H\x,g*-\T,p*) = -C^Tl 



Therefore, the optimal control maximizing the total divergence is a linear 
connection having the bang-bang-type components 

r 5jie^ if k = i, e^ ^ 

Fj = 5ue^ if fc = J, eV 

[ arbitrary, otherwise, 

8 



where e' = sgn(— C'). 

Moreover, the boundary constraints corresponding to these solutions are 

that is 



nu{x) (c'= - Vg'x'') (x) = 0, Vx G 9fi,„., 
and, together with the initial condition 

may help us to determine the solenoidal vector field C. 

Remark. If we replace the above maximum-type problem with a mini- 
mizing one, we obtain similar solutions, with e' = sgn(C'), / = 1, ...,n. 

3.2 Optimization of total Laplacian 

Let / : fij.,)^^ — )■ i? be a fixed differentiable function. The optimal control 
problem we are interested in consists in maximizing the functional 

(J) J[T] = f A^fdv = I g'^f,n,^da, 

subject to the dual metric compatibility evolution PDEs system 

da^^ r ■ • • • 1 

{PDE') -^{x) = -^(x) [6X,{x) + 6iTl,{x)] , t,j,k = l,...,n, 

with control restriction 

(rj,.) eu = {T: n,,^, ^ [-1, i]"^| r:;. = ry 

and with initial condition 



The running cost, respectively the boundary cost associated to this opti- 
mal control problem are 

X(x,5f"\r) = 0; xix,g~^) = g'^y/gfiUj, 

where fk{x) = -k^ and g^^ = g^^{x) denote the components of the inverse 
metric matrix. Again, the control Hamiltonian is 

H\x,g-\T,p) = -g'^Ti,p1^ 



and, since it is linear with respect to the control components F^-, we have no 
interior optimal control F^ . 

Writing the Riemannian maximum principle gives us the adjoint PDE 
system 



Q^k 



V 



dx^ 



Pis 



I -ps 



^^r^t + (^^r 



^i jk ' "j ik 1 

with same possible solution as in the previous section, that is p*^ = C'g*,, 



with c = (c^) : n,,.,, ^R ,7)^ 

tonian, we obtain 

H'ix,g*-\T.,p 



*k /^k , 

0. Replacing within the control Hamil- 



-C^FL. 



Therefore, the optimal control maximizing the gradient flux is of bang-bang- 
type 

if k = i, e^ ^ 



-p*k 
ij 



Sue' if k = J, e^ ^ 



arbitrary, otherwise, 

where e' = sgn(— C'). 

This time instead, the boundary constraints generating the solenoidal 
tensor field C are 



{nkC^'gmx) 



nkg 



*kl 



fidij + fj9ii - fWij) Vg*] (x), Va; G dQ^,^^. 



Remark. For both the foregoing problems, we may look for some par- 
ticular solutions. 



1. We may chose 



^^k 



S'[{S,ie') + S^{6ae')-6,,d''^{6pie') 



that is F* is an Euclidean conformal linear connection (see [S]), i.e. F* is 
conformal with the Levi-Civita connection associated to the Euclidean 
metric g^^ = 6ij. Then, the optimal Riemannian metric 



g*ij = X^ij^- 



dkl<^ X' 



is a soliton-type solution for the dual metric compatibility evolution 
(PDE) 

dg'^ 



dx^ 



\x 



-g^\x) 



5Ti{x) + Siniix 



-^p sk 



p sk\ 



and, also, is a dual Riemannian structure (a dual Riemannian metric 
having F* as Levi-Civita connection). 
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2. We may consider 






where Cj = ^ij-e-'. Then, the {PDE') system writes 



admitting the following soliton-type solution 



9^' 



^g-.U.fcX ^ g- 



-ntf^x'' 



e^e^ (no summation), 



where a, a* denote real constants, satisfying X^ILi '^* = 0- The dis- 
advantage of the latter solution is that it may not be a Riemannian 
structure, but only a symmetric (2, 0)-type tensor field or, in best case 
scenario (i.e. e* 7^ 0, V? = 1, ...jTi), a semi-Riemannian structure. 

4 The optimal geometry of pipes 

This section is meant to emphasize the practical utility of the theoretical 
facts described above, by analyzing a classical problem in Hydraulics and 
Fluid Mechanics. Given a pipe, in the general sense (water pipe, gas pipe, 
blood vessel) containing a fluid flow, it is well known that the Divergence 
Theorem helps us to measure the flux of the fluid flow through pipe walls. 
Sometimes instead, for practical reasons, it is of major utility to identify the 
optimal shape of the pipe, allowing the minimum flux through walls. This is 
the problem analyzed in this section. More precisely, given the directionality 
of the fluid through the pipe, we decide about the best way to conceive the 
pipe (the optimal geometric shape), such that the flux of the fluid through 
pipe walls to be minimal. 

Let D^ denote the closed disc of radius one and let M = D^ x (0, 1) be a 
differential manifold with boundary describing the interior and the boundary 
of a cylinder. We identify the pipe in the Euclidean space (in the sense 
of some diffeomorphism) with the manifold M. Given a flow through the 
pipe, described by a vector fleld F = X-^ + Y-^ + Z-^ on M, we shall 
find a Riemannian structure on M, minimizing the flux of F. For this, we 
consider the local map V = M — {{x,y,z) G M| y = 0, x > 0}. Using the 
cylindrical coordinates {p,9,z), we may identify V with the parallelepiped 
(0,1] X (0, 27r) X (0,1) in R'^. Moreover, we suppose that the expression of F 
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with respect to these new coordinates is F = R-^ + T-^ + C^-^. Then, 

i?(p, 6', z) = X{p cos 9, p sin 9, z) cos 9 + Y{p cos 6*, p sin 6', z) sin ^; 
< r(p, 9,z) = p [—X{p cos ^, p sin ^, z) sin 9 + Y{p cos 9, p sin 6*, 2;) cos 9] ; 
. C(p,6',z) = Z(p cos 6',p sin ^,2;), 

or, conversely. 



X{x, y, z) = R{^x^ + y\ arctan f , z) , !^ - T{^/x^Ty^, arctan |, z)?/; 

y^ +y 

Y{x,y, z) = R{y/x'^ + y'^, arctan |, z)—^ — = + T(a/xM^^^ arctan ^, 2;)x; 
Z(x, y, z) = ClVx^T^, arctan |, z). 

Applying the results derived in the previous section, we obtain the optimal 
Euclidean conformal structure 

gip, 9, z) = ire^^^"^!''''^))'' (dp" + d9'' + dz") . 



Using the above relations between the components of F relative to the cylin- 
drical and Cartesian coordinates we derive also the Cartesian expression of 
the optimal Riemannian structure: 



1 



'VV^^'V^^'^jv^^^ 



where 5" = sgn{N, F) on the boundary, ( , ) denotes the canonical inner 

dx ^ dy 



product on R^ and N{x, y, z) = x-§- + y^ is the normal vector field along 



the boundary of M. 

In conclusion, the direction of the flow F as vector field in R^ is directly 
involved in the geometric configuration of the pipe. More precisely, if F is 
pointed outward, then the diameter of the pipe increases; conversely, if F is 
pointed inward, the diameter decreases. Therefore, the optimal shape for the 
pipe walls is the one tangent, at each point, to the flow F. 
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